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Jt is Iherofore desirable to have a solution to this problem that minimues tha number of 
interrupts m dclennininB when a transaction (large data transfer) using RDMA has 
completed, 



Claim; 

Wo propose a method that reduces tlic number of interrupts. Each RDMA engine that 
receives some data for a transaction will produce one (and only one) interrupt/callback for 
that transacUon. Any RDMA engine that did not receive any data for a transaction will not 
produce any jntcnrupls for that transaction. 



Solution/Embodiment: 

Thti sender may send parts of data (packets) of the transaction over several network 
fabrics/connections. Wlien the sender has sent the last packet of data through a particular 
network, the sender will mark the end-of data through a marker that can be a flag (in the 
message header) that indicates that this is the last piece of data being sent on this network 
eonncclion/fabric for the particular transaction or an specially formatted messago (e g an 
empty RDMA packet). If the sender finished sending out data for a tmnsaction but i t had 
sent data earlier over a network without marking tho last packet sent on that network the 
sender must send a specially formatted message (e.g.. an empty RDMA packet) that i^arks it 
as the last packet being sent over that network for the particular transaction. Each receiver 
thus knows which packet is the last packet it will receive for a particular transaction Upon 
rcccivmg this last packet, the RDMA engine generates an interrupt/callback, informing the 
receiver how much data it has received on its network connection/fabric for the particular 
iransactton. The receiver then keeps track of the sum ofdata that arrived on each of the 
network connections/fabrics that reported data received for the particular transaction. When 
the total number of bytes for the transaction has been received via the various RDMA 
engines, ihe receiver kr\ows that the transaction Oarge data transfer) has completed. Any 
RDMA engine that did not process any packets far a transaction will not have generated an 
interrupt for that transaction. Any RDMA engine that did process packets for a transaction 
Will have generated a single interrupt for the transaction after it had processed all of the 
packets that are to arrive on its network connection/fahric. We have thus reduced the number 
of mterrupts needed to determine when a split RDMA transfer has been completed 
A vanant oFthis technique may involve the information sender to inform the receiver about 
the connections oa which it has sent data enabling him to cross-check the validity of tho 
receive-counts. 



